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Abstract. In this paper, we study the question of how efficiently a collection of interconnected 
nodes can perform a global computation in the widely studied QOSSXV model of communication. 
In this model, nodes do not know the global topology of the network, and they may only initiate 
contact with a single neighbor in each round. This model contrasts with the much less restrictive 
LOCAL model, where a node may simultaneously communicate with all of its neighbors in a single 
round. A basic question in this setting is how many rounds of communication are required for 
the information dissemination problem, in which each node has some piece of information and is 
required to collect all others. 

In the LOCAL model, this is quite simple: each node broadcasts all of its information in 
each round, and the number of rounds required will be equal to the diameter of the underlying 
communication graph. In the QOSSXV model, each node must independently choose a single 
neighbor to contact, and the lack of global information makes it difficult to make any sort of 
principled choice. As such, researchers have focused on the uniform gossip algorithm, in which each 
node independently selects a neighbor uniformly at random. When the graph is well-connected, 
this works quite well. In a string of beautiful papers, researchers proved a sequence of successively 
stronger bounds on the number of rounds required in terms of the conductance <f>, culminating in a 
bound of 0(4>~ logn). 

In this paper, we show that a fairly simple modification of the protocol gives an algorithm that 
solves the information dissemination problem in at most 0(D + polylog(n)) rounds in a network of 
diameter D, with no dependence on the conductance. This is at most an additive polylogarithmic 
factor from the trivial lower bound of D, which applies even in the LOCAL model. 

In fact, we prove that something stronger is true: any algorithm that requires T rounds in the 
LOCAL model can be simulated in 0(T + polylog(n)) rounds in the QOSSXV model. We thus 
prove that these two models of distributed computation are essentially equivalent. 
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1. Introduction 



Many distributed applications require nodes of a network to perform a global task using only 
local knowledge. Typically a node initially only knows the identity of its neighbors and gets to 
know a wider local neighborhood in the underlying communication graph by repeatedly communi- 
cating with its neighbors. Among the most important questions in distributed computing is how 



certain global computation problems, e.g., computing a maximal independent set 21 or a graph 
coloring (21, can be performed with such local constraints. 

Many upper and lower bounds for distributed tasks are given for the well-known LOCAL 
model |24[ Chapter 2], which operates in synchronized rounds and allows each node in each round 
to exchange messages of unbounded size with all of its neighbors. It is fair to say that the LOCAL 
model is essentially the established minimal requirement for a distributed algorithm. Indeed, when- 
ever a distributed algorithm is said to have running time T it is implied that, at the least, there 
exists a T-round algorithm in the LOCAL model. 

In many settings, practical system design or physical constraints do not allow a node to contact 
all of its (potentially very large number of) neighbors at once. In this paper we focus on this case 
and consider the QOSSXV model, which restricts each node to initiate at most one (bidirectional) 
communication with one of its neighbors per round. In contrast to computations in the LOCAL 
model, algorithms for the QOSSXV model have to decide which neighbor to contact in each round. 
This is particularly challenging when the network topology is unknown. 

Algorithms with such gossip constraints have been intensively studied for the so-called Rumor 
problem (also known as the rumor spreading or information dissemination problem), in which each 
node has some initial input and is required to collect the information of all other nodes. Most 
previous papers analyzed the simple Unif ormGossip algorithm, which chooses a random neighbor 
to contact in each round. The uniform gossip mixes well on well-connected graphs, and good bounds 
for its convergence in terms of the graph conductance have been given [4| |13[[23] . However, it has 
a tendency to repeatedly communicate between well-connected neighbors while not transmitting 
information across bottlenecks. Only recently have algorithms been designed that try to avoid 
this behavior. By alternating between random and deterministic choices, [3] showed that fast 
convergence can be achieved for a wider family of graphs, namely, those which have large weak 
conductance (a notion defined therein). However, while this outperformed existing techniques in 
many cases, its running time bound still depended on a notion of the connectivity of the graph. 

1.1. Our results. This paper significantly improves upon previous algorithms by providing 
the first information spreading algorithm for the QOSSXV model that is fast for all graphs, with 
no dependence on their conductance. Our algorithm requires at most 0(D + polylog(n)) rounds 
in a network of size n and diameter D. This is at most an additive poly logarithmic factor from 
the trivial lower bound of 0{D) rounds even for the LOCAL model. In contrast, there are many 
graphs with polylogarithmic diameter on which all prior algorithms have Vt{n) bounds. 

In addition, our results apply more generally to any algorithm in the LOCAL model. We show 
how any algorithm that takes T time in the LOCAL model can be simulated in the QOSSXV 
model in 0{T + polylog(n)) time, thus incurring only an additional polylogarithmic cost in the 
size of the network n. Our main result that leads to this simulation is an algorithm for the 
QOSSXV model in which each node exchanges information (perhaps indirectly) with each of its 
neighbors within a polylogarithmic number of rounds. This holds for every graph, despite the 
possibility of large degrees. A key ingredient in this algorithm is a recursive decomposition of 
graphs into clusters of sufficiently large conductance, allowing fast (possibly indirect) exchange 
of information between nodes inside clusters. The decomposition guarantees that the number of 
edges between pairs of nodes that did not exchange information decreases by a constant fraction. 
To convert the multiplicative polylogarithmic overhead for each simulated round into the additive 



overhead in our final simulation result we show connections between sparse graph spanners and 
algorithms in the QOSSXV model. This allows us to simulate known constructions of nearly- 
additive sparse spanners [26] . which then in turn can be used in our simulations for even more 
efficient communication. 



1.2. Our Techniques. The key step in our approach is to devise a distributed subroutine in 
the QOSSXV model to efficiently simulate one round of the HOC AC model by a small number of 
QOSSXV rounds. In particular, the goal is to deliver each node's current messages to all of its 
neighbors, which we refer to as the NeighborExchange problem. Indeed, we exhibit such an 
algorithm, called Superstep, which requires at most 0(log 3 n) rounds in the QOSSXV model for 
all graphs: 

Theorem 1.1. The Superstep algorithm solves NeighborExchange in the QOSSXV model in 
0(log 3 n) rounds. 

Our design for the Superstep algorithm was inspired by ideas from [3] and started with an 
attempt to analyze the following very natural algorithm for the NeighborExchange problem: In 
each round each node contacts a random neighbor whose message is not yet known to it. While 
this algorithm works well on most graphs, there exist graphs on which it requires a long time to 
complete due to asymmetric propagation of messages. We give an explicit example and discuss this 
issue in Section [6l 

The Superstep algorithm is simple and operates by repeatedly performing log 3 n rounds of 
the Unif ormGossip algorithm, where each node chooses a random neighbor to contact at each 
round, followed by a reversal of the message exchanges to maintain symmetry. From 4] or its 
strengthening [14] , it is known that all pairs of vertices (and in particular all pairs of neighbors) 
that lie inside a high-conductance subset of the underlying graph exchange each other's messages 



within a single iteration. An existential graph decomposition result, given in Corollary 3.4, shows 
that for any graph there is a decomposition into high-conductance clusters with at least a constant 
fraction of intra-cluster edges. This implies that the number of remaining message exchanges 
required decreases by a constant factor in each iteration, which results in a logarithmic number of 
iterations until NeighborExchange is solved. 

This gives a simple algorithm for solving the Rumor problem, which requires all nodes to 
receive the messages of all other nodes: By iterating Superstep D times, where D is the diameter 
of the network, one obtains an 0(D ■ log 3 n) round algorithm. This is at most an (9(log 3 n)-factor 
slower than the trivial diameter lower bound and is a drastic improvement compared to prior upper 
bounds 3,4, 13[|23| . which can be of order 0(n) even for networks with constant or logarithmic D. 

Beyond the Rumor problem, it is immediate that the NeighborExchange problem bridges 
the gap between the LOCAL and QOSSXV models in general. Indeed, we can simply translate 
a single round of a LOCAL algorithm into the QOSSXV model by first using any algorithm for 
NeighborExchange to achieve the local broadcast and then performing the same local com- 
putations. We call this a simulation and more generally define an (a(G), f3(G)) -simulator as a 
transformation that takes any algorithm in the LOCAL model that runs in T(G) rounds if the 
underlying topology is G, and outputs an equivalent algorithm in the QOSSXV model that runs 
in O n (a(G)) ■ T(G) + O n (f3) rounds. Thus, the simulation based on the Superstep algorithm gives 
a (log 3 n, 0)-simulator. 

In many natural graph classes, like graphs with bounded genus or excluded minors, one can 
do better. Indeed we give a simple argument that on any (sparse) graph with hereditary density 5 
there is a schedule of direct message exchanges such that NeighborExchange is achieved in 25 
rounds. Furthermore an order-optimal schedule can be computed in <51ogn rounds of the QOSSXV 
model even if 5 is not known. This leads to a (5, <51ogn)-simulator. 
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Another way to look at this is that communicating over any hereditary sparse graph remains 
fast in the QOSSXV model. Thus, for a general graph, if one knows a sparse subgraph that has 
short paths from any node to its neighbors, one can solve the NeighborExchange problem by 
communicating via these paths. Such graphs have been intensely studied and are known as spanners. 
We show interesting connections between simulators and spanners. For one, any fast algorithm for 
the NeighborExchange problem induces a sparse low-stretch spanner. The Superstep algorithm 
can thus be seen as a new spanner construction in the QOSSXV model with the interesting property 
that the total number of messages used is at most 0(nlog 3 n). To our knowledge this is the first 
such construction. This also implies that, in general, NeighborExchange requires a logarithmic 
number of rounds (up to log log n factors perhaps) in the QOSSXV model. Considering in the 
other direction, we show that any fast spanner construction in the LOCAL model can be used to 
further decrease the multiplicative overhead of our (log 3 n, 0)-simulator. Applying this insight to 
several known spanner constructions [6,10,26,27] leads to our second main theorem: 



Theorem 1.2. Every algorithm in the LOCAL model which completes in T = T(G) rounds when 
run on the topology G can be simulated in the QOSSXV model in 

O(l) -min |r • log 3 n, T ■ 2 log * n log n+ log 4 n, T ■ log n+ 2 log * n log 4 n, T+ log° (1) n, T ■ 5+5 log n, T ■ A j 
rounds, where n is the number of nodes, A the maximum degree and 5 the hereditary density of G. 

When we apply this result to the greedy algorithm for the Rumor problem, where T = D, we 
obtain an algorithm whose 0(.D + poly logn) rounds are optimal up to the additive poly logarithmic 
term, essentially closing the gap to the known trivial lower bound of £l(D). 

1.3. Related Work. The problem of spreading information in a distributed system was in- 
troduced by Demers et al. [5] for the purpose of replicated database maintenance, and it has been 
extensively studied thereafter. 

One fundamental property of the distributed system that affects the number of rounds required 
for information spreading is the communication model. The random phone call model was intro- 
duced by Karp et al. [15) . allowing every node to contact one other node in each round. In our 
setting, this corresponds to the complete graph. This model alone received much attention, such 
as in bounding the number of calls (7j, bounding the number of random bits used 14 , bounding 
the number of bits [12| , and more. 

The number of rounds it takes to spread information for the randomized algorithm 
Unif ormGossip, in which every node chooses its communication partner for the next round uni- 
formly at random from its set of neighbors, was analyzed using the conductance of the underlying 
graph by Mosk-Aoyama and Shah |23|, by Chierichetti et al. [4j, and later by Giakkoupis 13 



whose work currently has the best bound in terms of conductance, of rounds, with high 

probability. 

Apart from the uniform randomized algorithm, additional algorithms were suggested for spread- 
ing information. We shortly overview some of these approaches. Doerr et al. [8] introduce quasi- 
random rumor spreading, in which a node chooses its next communication partner by determin- 
istically going over its list of neighbors, but the starting point of the list is chosen at random. 
Results are O(logn) rounds for a complete graph and the hypercube, as well as improved com- 
plexities for other families of graphs compared to the randomized rumor spreading algorithm with 
uniform distribution over neighbors. This was followed by further analysis of the quasi-random al- 
gorithm [9 11 . A hybrid algorithm, alternating between deterministic and randomized choices [3], 



was shown to achieve information spreading in 0(c( + c)) round, w.h.p., where & C (G) is the 
weak conductance of the graph, a measure of connectivity of subsets in the graph. Distance-based 
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which also address gossip- 



bounds were given for nodes placed with uniform density in R d 
based solutions to specific problems such as resource location and minimum spanning tree. 

The LOCAL model of communication, where each node communicates with each of its neighbors 
in every round, was formalized by Peleg |24| . Information spreading in this model requires a number 
of rounds which is equal to the diameter of the communication graph. Many other distributed tasks 
have been studied in this model, and below we mention a few in order to give a sense of the variety 
of problems studied. These include computing maximal independent sets jljj, graph colorings (2], 
computing capacitated dominating sets |19|, general covering and packing problems |20|, and 
general techniques for distributed symmetry breaking 28 



2. Preliminaries and Definitions 

2.1. The Unif ormGossip Algorithm. The Unif ormGossip algorithm is a common algorithm 
for Rumor. (It is also known as the PUSH-PULL algorithm in some papers, such as |13| .) Initially 
each vertex u has some message M u . At each step, every vertex chooses a random incident edge 
(u, v) at which point u and v exchange all messages currently known to them. The process stops 
when all vertices know everyone's initial messages. In order to treat this process formally, for any 
fixed vertex v and its message M v , we treat the set of vertices that know M v as a set that evolves 
probabilistically over time, as we explain next. 

We begin by fixing an ambient graph G = (E,V), which is unweighted and directed. The 
Unif ormGossip process is a Markov chain over 2 V , the set of vertex subsets of G. Given a current 
state S C V, one transition is defined as follows. Every vertex u picks an incident outgoing edge 
Q-u = (u, w) £ E uniformly at random from all such candidates. Let us call the set of all chosen 
edges A = {a u : u £ V} an activated set. Further let A° = {(u,w) : (u,uu) £ A or (w,u) £ A} be 
the symmetric closure of A. The new state of the chain is given by S U B, where by definition a 
vertex v is in the boundary set B if and only if there exists u £ S such that (u, v) £ A°. Note that 
V is the unique absorbing state, assuming a non-empty start. 

We say that an edge (u,w) is activated if (u,w) £ A°. If we let S model the set of nodes in 
possession of the message M v of some fixed vertex v and we assume bidirectional message exchange 
along activated edges, the new state S U B (of the Markov process) actually describes the set of 
nodes in possession of the message M v after one distributed step of the Unif ormGossip algorithm. 

Consider a r-step Markov process K, whose activated sets at each step are respectively Ai, . . . , A T . 
Let the reverse of K, written K ICV , be the r-step process defined by the activated sets A T , ... ,A%, 
in this order. For a process K, let K(S) denote the end state when started from S. 

Without loss of generality, for our analysis we will assume that only a single "starting" ver- 
tex s has an initial message M s . We will be interested in analyzing the number of rounds of 
Unif ormGossip that ensure that all other vertices learn M s , which we call the broadcast time. 
Clearly, when more than one vertex has an initial message, the broadcast time is the same since all 
messages are exchanged in parallel. 

Lemma 2.1 (Reversal Lemma). If u £ K({w}), then w £ K Tev ({u}). 

In communication terms, the lemma says that if u receives a message originating at w after r 
rounds determined by K, then w will receive a message originating at u after r rounds determined 
by K iev . 

Proof. The condition u £ K({w}) holds if and only if there exists a sequence of edges 
(e^, . . . ,ej r ) such that e^, £ A°. for all j, the indices are increasing in that i\ < ■ ■ ■ < i r , and 
the sequence forms a path from w to u. The presence of the reversed sequence in K mv implies 
w £ K vev ({u}). □ 
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2.2. Conductance. The notion of graph conductance was introduced by Sinclair 29 . We 
require a more general version, which we introduce here. We begin with the requisite notation on 
edge- weighted graphs. We assume that each edge (u, v) has a weight w uv G [0, 1]. For an unweighted 
graph G = (V, E) and any u, v £ V, we define w uv = 1 if (it, v) £ E and w uv = otherwise. Now 
we set w(S, T) = ^2 u& sveT w uv Note that in this definition it need not be the case that SnT = 0, 
so, e.g., w(S, S), when applied to an unweighted graph, counts every edge in S twice. The volume 
of a set Scy with respect to V is written as vol(5) = w(S, V). Sometimes we will have different 
graphs defined over the same vertex set. In such cases, we will write the identity of the graph as 
a subscript, as in vole? (S), in order to clarify which is the ambient graph (and hence the ambient 
edge set). Further, we allow self- loops at the vertices. A single loop at v of weight a is modeled by 
setting w vv = 2a, because both ends of the edge contribute a. 

For a graph G = (V, E) and a cut (S, T) where S, T C V and S n T = (but where T U S does 
not necessarily equal all of V), the cut conductance is given by 

,g rp\ = W(S, T) 

min { vol G (S'), vol G (T)} 

For a subset H C V we need to define the conductance of H (embedded) in V . We will use this 
quantity to measure how quickly the Unif ormGossip algorithm proceeds in H, while accounting 
for the fact that edges in (H, V — H) may slow down the process. The conductance of H in G is 
defined by 

(2) *{H) = wpi<p{S,H-S) 

Note that the classical notion of conductance of G (according to Sinclair |29j) equals 3>(V) in 
our notation. 

When we want to explicitly emphasize the ambient graph G within which H resides, we will 
write &g(H). 

A few arguments in this paper will benefit from the notion of a "strongly induced" graph of a 
vertex subset of an ambient graph G. 

Definition 2.2. Let U C V be a vertex subset of G. The strongly induced graph of U in G is a 
(new) graph H with vertex set U , whose edge weight function h : U x U — > R is defined by 



h„ 




ifu^v, 
xt =.y —U w ux i ifu = V. 



Note that by construction we have &h(U) = $g(J7). The significance of this notion is the 
fact that the Markov process, describing the vertex set in possession of some message M s for 
a starting vertex s G U in the Unif ormGossip algorithm executed on the strongly induced H, 
behaves identically to the respective process in G observed only on U. In particular, this definition 
allows us to use Theorem 1 of |13l in the following form: 



Theorem 2.3. For any graph G = (V,E) and a subgraph U C V and any start vertex in U, the 
broadcast time of the Unif ormGossip algorithm on U is O^ciU)^ 1 log \U\) rounds w.h.p. 

3. Solving NeighborExohange in 0(log 3 n) Rounds 

The idea behind our algorithm for solving the NeighborExchange problem is as follows. 
For every graph there exists a partition into clusters whose conductance is high, and therefore the 
Unif ormGossip algorithm allows information to spread quickly in each cluster. The latter further 
implies that pairs of neighbors inside a cluster exchange their messages quickly (perhaps indirectly) . 
What remains is to exchange messages across inter-cluster edges. This is done recursively. In the 
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following subsection we describe the conductance decomposition and then in Subsection ^2 we give 
the details for the algorithm together with the proof of correctness. 



3.1. Conductance Decomposition of a Graph. As described, our first goal is to partition 
the graph into clusters with large conductance. The challenge here is to do so while limiting the 
number of inter-cluster edges, so that we can efficiently apply this argument recursively. (Otherwise, 
this could be trivially done in any graph, for example by having each node as a separate cluster.) 
We are going to achieve this in the following lemma whose proof (found in Appendix [A]) is very 
similar to that of Theorem 7.1 in |30| . Note that for our eventual algorithm, we are only going to 
need an existential proof of this clustering and not an actual algorithm for finding it. 

Lemma 3.1. Let S cy be of maximum volume such that vol(S') < vol(y)/2 and (p(S, V — S) < £, 
for a fixed parameter £ > $(G). J/vol(S) < vol{V)/4, then $(V - S) > f/3. 



Lemma 3.1 says that if a graph has no sparse balanced cuts, then it has a large subgraph which 



has no sparse cuts. The following corollary establishes that Lemma 3.1 holds even in the case when 
the ambient graph is itself a subgraph of a larger graph. 

Corollary 3.2. Let U C V and let S C U be of maximum volume such that vol(S') < vo\(U)/2 
and ip(S, U-S)<£, for a fixed parameter £ > $([/). Ifvol(S) < vol(U)/A, then $(U - S) > £/3. 



Proof. Observe that the proof of Lemma 3.1 holds when the graph has loops, i.e. w uu ^ 



for some it's. Let H be the strongly induced graph of U. It follows from the definition that for any 
two disjoint sets A, B C U we have vo1g(^4) = voljj(A) and w(A,B) = h(A,B). We can therefore 
apply Lemma |3.1| to H and deduce that the statement holds for the respective sets in G. □ 



We are now ready to state and analyze the strong clustering algorithm. We emphasize that 
this is not a distributed algorithm, but an algorithm that only serves as a proof of existence of the 
partition. First, consider the following subroutine: 

Cluster (G,U ,0 : 

The inputs are a graph G = (V,E), a subset U C V and a parameter < £ < 1. 

1. Find a subset S C U of maximum volume such that vol(S') < vo\(U)/2 and ip(S, U — 
S)<£. 

2. If no such S exists, then stop and output a single cluster {U}. Otherwise, 
3a. Jfvol(S) <vol(J7)/4, output {U — S}U Cluster (£?,£,£). 

3b. Jfvol(S) >vol(?7)/4, output Cluster (G, S,0 U Cluster (G, U - S,0- 

The clustering algorithm for a graph G = (V, E) is simply a call to Cluster (G , V , £) • The following 
theorem is proven in Appendix [B| 

Theorem 3.3. For every < £ < 1, every graph G = (V, E) with edge weights w uv G {0}U [1, +oo) 
has a partition V = V% U • • • U Vk such that $>(Vi) > i og4 3 voi(y) > f or a ^ an< ^ ^i<j ^j) — 

f voi(y). 

In this paper, we are going to use the following specialization of this theorem, obtained by 
plugging in £ = 1/3: 

Corollary 3.4. Every unweighted graph on m edges has a clustering that cuts at most y edges 
and each cluster has conductance at least ^ — 1 „ . 

31og 4 / 3 2m 

3.2. The Superstep Algorithm for the NeighborExchange Problem. In this section, 
we will the describe the Superstep algorithm, which solves the NeighborExchange problem. 
Recall that, for this problem, all vertices v are assumed to possess an initial message M v , and the 
goal is for every pair of neighbors to know each other's initial messages. 
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We now describe our communication protocol, which specifies a local, per-vertex rule that tells 
a node which edge to choose for communication at any given round. It is assumed that the node 
will greedily transmit all messages known to it whenever an edge is chosen for communication. The 
protocol described here will employ some auxiliary messages, which are needed exclusively for its 
internal workings. 

The Superstep subroutine described in this section is designed to ensure that, after a single 
invocation, all neighbors (u, w) in an undirected graph G have exchanged each other's initial mes- 
sages. Clearly then, D invocations of Superstep, where D is the diameter of G, ensure that a 
message starting at vertex v reaches all u E V, and this holds for all messages. D invocations of 
Superstep thus resolve the RUMOR problem. 

If E is a set of undirected edges, let E = {(u,w) : {u, w} E E} be the corresponding directed 
graph. 

Superstep (G ,t) : 

The parameter G = (V, E) is an unweighted, undirected graph, and r is a positive integer. 
Set F := E and i := 0. While F, ^ 0, repeat: 

1. (First half) 

la. Initialize every vertex v with a new auxiliary message a(v), unique to v. 
(This messages is added to the set of initial messages that v happens to know 
currently.) 

lb. Perform the Unif ormGossip algorithm with respect to for r rounds. And 
denote the outcome of the random activated edge choices by Ki 

lc. For every vertex u and neighbor w, let X uw be the indicator that u received 
a{w) 

2. (Second half) 

2a. Initialize every vertex v with a fresh auxiliary message b(v), unique to v 
2b. Perform K\ ey , the reverse process of the one realized in Step lb 
2c. For every vertex u and neighbor w, let Y uw be the indicator that u received 
b(w) 

3. (Pruning) Compute the set of pruned directed edges Pi — {(it, w) : X uw +Y UW > 0} 

4. Set F i+ i := F 4 - P l and i := i + 1 

It is easily verified that the above algorithm can be implemented in the QOSSXV model of com- 
munication. 

Theorem 3.5. Let G = (V,E) be an undirected, unweighted graph with \V\ = n and \E\ = m. 
Then, after one invocation of Superstep (G,t) , where r = 0(log 2 m) ; the following hold with 
probability 1 — l/n^h 

(i) Every pair of neighbors {u, w} E E receive each other's messages. 

(ii) The algorithm performs 0(log 3 m) distributed rounds. 



Our proof of Theorem 3.5 is structured as follows. Let E = Fq, . . . = be the respective 
edge sets of each iteration in Superstep. We are going to show that, with probability 1 — l/n^ l \ 
the following invariants are maintained at each iteration: 

(a) The directed edge set Fi is symmetric in the sense that (u,w) £ F% => (w,u) E Fi, 

(b) The size of Fi reduces by a constant factor at each iteration. Formally, vol(-Fj+i) < 
i vol(Fj), and 

(c) After the i-th iteration, for every (u, w) E E — i^+i, vertex u has received the message of 
vertex w and vice-versa. 



Since F^ = 0, claim (c) implies part (i) of Theorem 3.5 Claim (b) implies that the maximum 



number of iterations is log 2m. Noting that every iteration entails 2r distributed rounds, establishes 



part (ii) of Theorem 3.5 



Proof of Claim (a): Initially, Fq is symmetric by construction. Inductively, assume that Fi 
is symmetric. The Reversal Lemma applied to Ki and KJ ey implies X uw = Y wu , for all u,w E V. 
This in turn implies that X uw + Y uw = X wu + Y wu , so Pi is symmetric. Since Fi is symmetric by 
hypothesis, we can conclude that Pj+i = Fi — Pi is symmetric as well. □ 

Proof of Claim (b): Consider the graph Gi = (V, Fi) on the edge set Fi. Since Fi is symmet- 
ric, by Claim (a), we can treat Gi as undirected for the purposes of analyzing the Unif ormGossip 
algorithm. Let V\ U • • • U be the decomposition of Gi promised by Corollary |3.4| (Note that the 
corollary holds for disconnected graphs, which may arise.) We thus have &(Vj) > 3 i og 4 /32m > ^ or a ^ 
1 < j < k. 



The choice r = 0(31og 4 / 3 2m • logm) ensures, via Theorem 2.3, that the first Unif ormGossip 
execution in every iteration mixes on all Vj with probability 1 — l/rf 1 ^. Mixing in Vj implies that 
for every internal edge (u, w), where u,w 6 Vj and (u,w) 6 Fi, the vertices (u,w) receive each 
other's auxiliary messages. The latter is summarized as X uw = X wu = 1. Applying the Reversal 
Lemma to the second execution of the Unif ormGossip algorithm, we deduce that Y uw = Y wu = 1 
as well. These two equalities imply, by the definition of Pi, that Pi is a superset of the edges not cut 



by the decomposition V\ U • • • U Equivalently, Fj+i is a subset of the cut edges. Corollary 3.4 
however, bounds the volume of the cut edges by ^vol(Fi), which concludes the proof of Claim 
(b). ' ' □ 

Proof of Claim (c) : Initially, E — Fq = and so the claim holds trivially. By induction, the 
claim holds for edges in E — Fi . And so it suffices to establish that u and v exchange their respective 
payload messages for all (u,w) G Pj. However, this is equivalent to the conditions X uw + Y uw > 0, 
which are enforced by the definition of Pj. □ 



Finally, our main result, Theorem follows as a corollary of Theorem 3.5 



4. Solving NeighborExchange in Hereditary Sparse Graphs 

Now we ask what can be achieved if instead of exchanging information indirectly as done in 
the Superstep algorithm, we exchange information only directly between neighbors. We will show 
in this section that this results in very simple deterministic algorithms for an important class of 
graphs that includes bounded genus graphs and all graphs that can be characterized by excluded 
. The results here will be used for the more general simulators in Section [5] 
As before we will focus on solving the NeighborExchange problem. One trivial way to solve 
this problem is for each node to contact its neighbors directly, e.g., by using a simple round robin 
method. This takes at most A time, where A is the maximum-degree of the network. However, 
in some cases direct message exchanges work better. One graph that exemplifies this is the star 
graph on n nodes. While it takes A = n time to complete a round robin in the center, after just a 
single round of message exchanges each leaf has initiated a bidirectional link to the center and thus 
exchanged its messages. On the other hand, scheduling edges cannot be fast on dense graphs with 
many more edges than nodes. The following lemma shows that the hereditary density captures how 
efficient direct message exchanges can be on a given graph: 

Lemma 4.1. Let the hereditary density 5 of a graph G be the minimal integer such that for every 
subset of nodes S the subgraph induced by S has at most density 5, i.e., at most 5\S\ edges. 

(1) Any schedule of direct message exchanges that solves the NeighborExchange problem 
on G takes at least 5 rounds. 

(2) There exists a schedule of the edges of G such each node needs only 25 direct message 
exchanges to solve the NeighborExchange problem. 
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Proof. Since the hereditary density of G is 5, there is a subset of nodes Scy with at least 
S\S\ edges between nodes in S. In each round, each of the |5| nodes is allowed to schedule at most 
one message exchange, so a simple pigeonhole principle argument shows that at least one node 
needs to initiate at least 5 message exchanges. 

For the second claim, we are going to show that for any e > there is an 0(e~ 1 logn)-time 
deterministic distributed algorithm in the COCAC model that assigns the edges of G to nodes such 
that each node is assigned at most 2(1 + e)5 edges. Then setting e < (35) _1 makes the algorithm 
inefficient but finishes the existential proof. 

The algorithm runs in phases in which, iteratively, a node takes responsibility for some of the 
remaining edges connected to it. All edges that are assigned are then eliminated and so are nodes 
that have no unassigned incident edges. In each phase, every node of degree at most 2(1 + e)5 
takes responsibility for all of its incident edges (breaking ties arbitrarily). At least a 1/(1 + -) 
fraction of the remaining nodes fall under this category in every phase. This is because otherwise, 
the number of edges in the subgraph would be more than (\S\ — |S|/(1 + *))(2(1 + e)5)/2 = \S\5, 
which would contradict the fact thatthe hereditary densityof the graph equals 5 of. What remains 
after each phase is an induced subgraph which, by definition of the hereditary density, continues 
to have hereditary density at most 5. The number of remaining nodes thus decreases by a factor of 
1 — 1/(1 + ^) in every phase and it takes at most 0(log 1+e n) phases until no more nodes remain, 
at which point all edges have been assigned to a node. □ 



We note that the lower bound of Lemma |4.1| is tight in all graphs, i.e., the upper bound of 25 
can be improved to 5. Graphs with hereditary density 5, also known as (0, 5)-sparse graphs, are 
thus exactly the graphs in which 5 is the minimum number such that the edges can be oriented to 
form a directed graph with outdegree at most 5. This in turn is equivalent to the pseudoarboricity 
of the graph, i.e., the minimum number of pseudoforests needed to cover the graph. Due to the 
matroid structure of pseudoforests, the pseudoarboricity can be computed in polynomial time. For 
our purposes the (non-distributed) algorithms to compute these optimal direct message exchange 
schedule are too slow. Instead, we present a simple and fast algorithm, based on the COCAC 



algorithm in Lemma 4.1 which computes a schedule that is within a factor of 2 + e of the optimal. 
We note that the DirectExchange algorithm presented here works in the QOSSXV model and 
furthermore does not require the hereditary density 5 to be known a priori. The following is the 
algorithm for an individual node v: 

DirectExchange : 

Set 5' = 1 and H = 0. H is the subset of neighbors in T(v) that node v has exchanged 
messages with. Repeat: 

S' = (l + e)S' 

for 0{- ■ logn) rounds do 
if \T(v) \H\<5' 

during the next 5' rounds exchange messages with all neighbors in T(v)\ 
H 

terminate 

else 

wait for 5' rounds 
update H 

Theorem 4.2. For any constant e > 0, the deterministic algorithm DirectExchange solves the 
NeighborExchange problem in the QOSSXV model using 0( Sl °§ n ) rounds, where 5 is the hered- 
itary density of the underlying topology. During the algorithm, each node initiates at most 2(l+e) 2 5 
exchanges. 



Proof. Let 5 be the hereditary density of the underlying topology. We know from the proof of 



Lemma 4.1 that the algorithm terminates during the for-loop if 5' is at least 2(1 + e)5. Thus, when 
the algorithm terminates, 6' is at most 2(1 + e) 2 5 which is also an upper bound on the number of 
neighbors contacted by any node. In the (i + l) th -to-last iteration of the outer loop, 5' is at most 
2(l + e) 2 5/(l + e)\ and the running time for this phase is thus at most 2(l + e) 2 <5/(l + e) 4 m O{\ logn). 
Summing up over these powers of 1/(1 + e) results in a total of at most <5/((l + e) — 1) • 0(- logn) = 
OC 51 ^) rounds. □ 

5. Simulators and Graph Spanners 

In this section we generalize our results to arbitrary simulations of COCAC algorithms in the 
QOSSXV model and point out connections to graph spanners, another well-studied subject. 

Recall that we defined the NeighborExchange problem exactly in such a way that it simulates 
in the QOSSXV model what is done in one round of the COCAC model. With our solutions, 
an 0(c) log n)-round algorithm and an 0(log 3 n)-round algorithm for the NeighborExchange 
problem in the QOSSXV model, it is obvious that we can now easily convert any T- round algorithm 
for the COCAC model to an algorithm in the QOSSZV model, e.g., by T times applying the 
Superstep algorithm. In the case of the DirectExchange algorithm we can do even better. While 
it takes O (5 logn) rounds to compute a good scheduling, once it is known it can be reused and 
each node can simply exchange messages with the same 0(5) nodes without incurring an additional 
overhead. Thus, simulating the second and any further rounds can be easily done in 0(5) rounds 
in the QOSSXV model. This means that any algorithm that takes 0(T) rounds to complete in the 
COCAC model can be converted to an algorithm that takes 0(5T + 5logn) rounds in the QOSSXV 
model. We call this a simulation and define simulators formally as follows. 

Definition 5.1. An (a, (3) -simulator is a way to transform any algorithm A in the COCAC model 
to an algorithm A' in the QOSSXV model such that A' computes the same output as A and if A 
takes 0(T) rounds than A' takes at most 0(aT + /3) rounds. 

Phrasing our results from Section |3.2| and Section [4] in terms of simulators we get the following 
corollary. 

Corollary 5.2. For a graph G of n nodes, hereditary density 5, and maximum degree A, the 
following hold: 

• There is a randomized (log 3 n, 0)- simulator. 

• There is a deterministic ( A, 0)- simulator. 

• There is a deterministic (2(1 + e) 2 5,0 (5 e~ 2 log n))- simulator for any e > or, simply, 
there is a {5, 8 logn) -simulator. 

Note that for computations that require many rounds in the COCAC model the (2(1 + 
e) 2 8, 0(5e~ 2 log n))-simulator is a logn-factor faster than repeatedly applying the DirectExchange 
algorithm. This raises the question whether we can similarly improve our (log 3 n, 0)-simulator to 
obtain a smaller multiplicative overhead for the simulation. 

What we would need for this is to compute, e.g., using the Superstep algorithm, a schedule 
that can then be repeated to exchange messages between every node and its neighbors. What we 
are essentially asking for is a short sequence of neighbors for each node over which each node can 
indirectly get in contact with all its neighbors. Note that any such schedule of length t must at 
least fulfill the property that the union of all edges used by any node is connected (if the original 
graph G is connected) and even more that each node is connected to all its neighbors via a path 
of length at most t. Subgraphs with this property are called spanners. Spanners are well-studied 
objects, due to their extremely useful property that they approximately preserve distances while 
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potentially being much sparser than the original graph. The quality of a spanner is described by 
two parameters, its number of edges and its stretch, which measures how well it preserves distances. 



Definition 5.3 (Spanners). A subgraph S = (V,E') of a graph G = (V, E) is called an (a, (3)- 
stretch spanner if any two nodes u, v with distance d in G have distance at most ad + ft in S. 

From the discussion above it is also clear that any solution to the NeighborExchange problem 
in the QOSSXV model also computes a spanner as a byproduct. 

Lemma 5.4. If A is an algorithm in the QOSSXV model that solves the NeighborExchange 
problem in any graph G in T rounds then this algorithm can be used to compute a (T,0)-stretch 
spanner with hereditary density T in 0(T) rounds in the QOSSXV model. 

While there are spanners with better properties than the (log 3 n, 0)-stretch and log 3 n-density 



implied by Lemma 5.4 and Theorem 3.5 our construction has the interesting property that the 
number of messages exchanged during the algorithm is at most 0(n log 3 n), whereas all prior 
algorithms rely on the broadcast nature of the LOCAL model and therefore use already 0(n 



2\ 



messages in one round on a dense graph. Lemma 5.4 furthermore implies a nearly logarithmic 
lower bound on the time that is needed in the QOSSXV model to solve the NeighborExchange 
problem: 

Corollary 5.5. For any algorithm in the QOSSXV model that solves the NeighborExchange 
problem there is a graph G on n nodes on which this algorithm takes at least ^( w^gn ) roun ds,- 

Proof. Assume an algorithm takes at most T(n) rounds on any graph with n nodes. The edges 



used by the algorithm form a T(n)-stretch spanner with density T(n), as stated in Lemma 5.4 For 



values of T(n) which are too small it is known that such spanners do not exist 25 . More specifically 
it is known that there are graphs with n nodes, density at least l/4n 1//r and girth r, i.e., the length 
of the smallest cycle is r. In such a graph any (r — 2)-stretch spanner has to be the original graph 
itself, since removing a single edge causes its end-points to have distance at least r — 1 , and thus the 
spanner also have density l/4n 1 / r . Therefore T{n) > argmin r {r — 2, l/4n 1//r } = aj ^ 1 "^^ ), □ 

Interestingly, it is not only the case that efficient simulators imply good spanners but the next 
lemma shows as a converse that good existing spanner constructions for the LOCAL model can be 
used to improve the performance of simulators. 

Theorem 5.6. If there is an algorithm that computes an (a, ft) -stretch spanner with hereditary 
density 5 in 0(T) rounds in the LOCAL model than this can be combined with an (a' , (3') -simulator 
to an (a5,Ta' + ft' + <51ogn + 5 (3) -simulator. 

Proof. For simplicity we first assume that ft = 0, i.e., the spanner S computed by the al- 
gorithm in the LOCAL model has purely multiplicative stretch a and hereditary density 5. Our 
strategy is simple: We are first going to compute the good spanner by simulating the spanner 
creation algorithm from the LOCAL model using the given simulator. This takes Ta' + ft' rounds 
in the QOSSXV model. Once this spanner S is computed we are only going to communicate via 
the edges in this spanner. Note that for any node there is a path of length at most a to any of 
its neighbors. Thus if we perform a rounds of £0C„4X-flooding rounds in which each node for- 
wards all messages it knows of to all its neighbors in S each node obtains the messages of all its 
neighbors in G. This corresponds exactly to a NeighborExchange in G. Therefore if we want 
to simulate T' rounds of an algorithm A in the LOCAL model on G we can alternatively perform 
aT LOCAL computation rounds on S while doing the LOCAL computations of A every a rounds. 
This is a computation in the LOCAL model but on a sparse graph. We are therefore going to 



use the (0(5), 0(<51ogn))-simulator from Corollary 5.2 to simulate this computation which takes 
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0(5aT' + <51ogn) rounds in the QOSSXV model. Putting this together with the Ta' + /3' rounds 
it takes to compute the spanner S we end up with 5aT' + 5 log n + Ta' + (3' rounds in total. 

In general (i.e., for j3 > a) it is not possible (see, e.g., Corollary 5.5) to simulate the LOCAL 



algorithm step by step. Instead we rely on the fact that any LOCAL computation over T rounds can 
be performed by each node first gathering information of all nodes in a T-neighborhood and then 
doing LOCAL computations to determine the output. For this all nodes simply include all their 
initial knowledge (and for a randomized algorithm all the random bits they might use throughout 
the algorithm) in a message and flood this in T rounds to all node in their T-neighborhood. Because 
a node now knows all information that can influence its output over a T-round computation it can 
now locally simulate the algorithm for itself and its neighbors to the extend that its output can be 
determined. Having this we simulate the transformed algorithm as before: We first precomute S 
in Ta' + (3' time and then simulate the T' rounds of flooding in G by performing aT' + f3 rounds 
of £0O4£-flooding in S. Using the (0(5), 0(Jlogra))-simulator this takes 0(5(aT' + (3) + <51ogn) 
rounds in the QOSSXV model. 

□ 

Corollary 5.7. There is a (2 log n log n, log 4 n)- simulator, a (logn, 2 log n log 4 n)- simulator and a 
(0(1), polylogn) -simulator. 

Proof. We are going to construct the simulators with increasingly better multiplicative over- 
head by applying Theorem 5.6 to existing spanner constructions [6j[l0}[26l[27] for the LOCAL 



model. We first construct a (log n, log n)-simulator by combining our new (log n, 0)-simulator 
with the deterministic spanner construction in m\. The construction in [6] takes O(logra) rounds in 
the LOCAL model and adds at most one e dge t o each node per round. Using a = T = 5 = 0(log n 
log 3 n and (3 



a' = log" n ana p = f3' = in Theorem 
this simulator, we can use 



27 



5.6 



tive simulation overhead the same 
hereditary density 5 = 0(1 



gives the desired (log 2 n, log 4 ra)-simulator. Having 
to impr ove the multiplicative overhead while keeping the addi- 
an a = (2 log n log n)-stretch spanner with constant 
is constructed in T = 0(2 log n log n)-t ime in the LOCAL model. Us- 

leads to the strictly better 



5.6 



ing these parameters and the (log n, log n)-simulator in Theorem 
(2 log n logn, log 4 n)-simulator claimed here. Having this simulator, we can use it with the random- 
ized spanner construction in |10|. There, an a-stretch spanner, with a = O(logn), is constructed 
in T = 0(log 3 n)-time in the LOCAL model by extracting a subgraph with fi(logn) girth. Such 
a graph has constant hereditary density 5 = 0(1), as argued in |25|. Using these parameters and 



the (2 log n log n, log 4 n)-simulator in Theorem 5.6 leads to the (logn,2 log n log 4 n)-simulator. Fi- 



nally, we can use any of these simulators together with the nearly-additive (5 + e, polylogn)-spanner 
construction from [26] to obt ain o ur last simulator. It is easy to verify that the randomized con- 
struction named AD^^ n in [26] can be computed in a distributed fashion in the LOCAL model 
in poly logn time and has hereditary density 5 = 0(1). This together with any of the previous 
simulators and Theorem 5.6 results in a (0(1), polylogn)-simulator. □ 



With these various simulators it is possible to simulate a computation in the LOCAL model 
with very little (polylogarithmic) multiplicative or additive overhead in the QOSSXV model. Note 
that while the complexity of the presented simulators is incomparable, one can interleave their 
executions (or the executions of the simulated algorithms) and thus get the best runtime for any 
instance. This, together with the results from Corollary |5.7| and 5.2, proves our main result of 
Theorem Ol 



6. Discussion 



This paper presents a more efficient alternative to the Unif ormGossip algorithm that allows 
fast rumor spreading on all graphs, with no dependence on their conductance. We then show how 
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Figure 1 . An example illustrating the behavior of the algorithm choosing a random 
neighbor whose information is still unknown. 



this leads to fast simulation in the QOSSXV model of any algorithm designed for the LOCAL 
model by constructing sparse spanners. This work leaves some interesting directions for future 
work, which we discuss below. 

First, as mentioned in the introduction, there are cases in which the algorithm where each 
node chooses a neighbor uniformly at random only from among those it has not yet heard from 
(directly or indirectly), performs slower than the optimal. An example is the graph in Figure [6j 
where Cj stands for a clique of size 0(1) in which every node is also connected to the node X{. 
In this example, it takes 2 rounds for the node w to hear about the node v (through nodes in 
{#!,..., zo(\ og n)})- During these rounds there is a high probability that a constant fraction of the 
nodes in {m, . . . , uqua) did not yet hear from neither v nor w. With high probability, a constant 
fraction of these will contact w before contacting v, after which they will not contact v anymore 
because they will have heard from it through w. This leaves 0(n) nodes which v has to contact 
directly (since nodes in {z±, . . . , ^o(iogn)} are no longer active since they already heard from both 
of their neighbors), resulting in a linear number of rounds for NeighborExchange. 

We note, however, that this specific example can be solved by requiring nodes that have heard 
from all their neighbors to continue the algorithm after resetting their state, in the sense that they 
now consider all their neighbors to be such that they have not heard from (this is only for the sake 
of choosing the next neighbor to contact, the messages they send can include previous information 
they received). Therefore, we do not rule out the possibility that this algorithm works well, but 
our example suggests that this may not be trivial to prove. 

Second, regarding our solution to the Rumor problem, the Superstep algorithm, as presented, 
can be implemented in synchronous environments in a straightforward manner. To convert our 
algorithm to the asynchronous setting, one needs to synchronize the reversal step. Synchronization 
is a heavy-handed approach and not desirable in general. 

To alleviate this problem, we believe, it is possible to get rid of the reversal step altogether. 
The basic idea is to do away with the hard decisions to "remove" edges once a message from a 
neighbor has been received. And instead to multiplicatively decrease the weight of such edges 
for the next round. This approach would introduce a slight asymmetry in each edge's weight in 
both directions. In order to analyze such an algorithm, it is needed to understand the behavior 
of RandomNeighbor in the general asymmetric setting. In this setting, each vertex uses its own 
distribution over outgoing links when choosing a communication partner at each step. We believe 
that understanding the asymmetric RandomNeighbor is an open problem of central importance. 
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Appendix A. Proof of Lemma |3.1| 

Proof. Assume, towards a contradiction, that <&(V — S) < £/3. Then, there exists a cut (P, Q) 
of V — S with ip(P, Q) < £/3 and specifically 

(3) U(P,Q) w{P,Q) \ £ 

(3) maX \ vol(P) ' vol(Q) ) ~ 3 

Henceforth, let Q be the smaller of the two, i.e. vol(Q) < vol(V — S)/2. 

We are going to show that ip(S U Q, P) < £ and either S U Q or P should have been chosen 
instead of S. 

Consider the case vol (5 U Q) < vol(V)/2. In this case, 

<p{S UQ,P) = W{S ' P) + W{Q ' P) ~ W{S ' P) + W{Q ' P) 



vol(S U Q) val(S) + vol(Q) 

{e,e/3} = e 



w(S,P) w(Q,P) w(S,P) + w(S,Q) w(Q,P) 
< max < — — — , , ; — > < max < — — , , , — > < max 



vol(5) ' vol(Q) J - | vol(5) ' vol(Q) 

This establishes a contradiction, because ip(S UQ,P) < £ and vol(S') < vol(5 U Q) < vol(V)/2. 

Now let's consider the case vol (5 U Q) > vol(V)/2. First, we argue that vol(<5 U Q) cannot be 
too large. We use that vol(Q) < \ vol(F - S) = g(vol(V) - vol(5)). 

i, n s~\ \ ,/«\ ^ -itns vol(V) - volfS 1 ) vol(V) + volfS 1 ) ^ 5 .._ T . 

(4) vol(5 UQ) = vol(S) + vol(Q) < vol(5) + — ^- L - — = — ^- L - — < - vol(V) 

2 2 o 

Hence, vol(P) > |vol(V). In addition, for the cut size, we have 

w(S U Q, P) = w{S, P) + w(Q, P) 
<Zvol(S) + ^vol(Q) 

< ^vol(S) + ^vol(V) 

O D 

= ^voi(y) 
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And now we can bound the cut conductance: 

(5) ,(5uQP)- w(5uQ ' p) < ^ vol(F) -r 

(5) ^ UQ ' F >- V ol(P) " | vol(V) " 5 

This also establishes a contradiction because ^(SUQ, P) < £ while vol(S) < | vol(y) < § vol(V) < 
vol(P) < \ vol(V). □ 



Appendix B. Proof of Theorem 3.3 



Proof. The depth K of the recursion is, by construction, at most log 4 / 3 vol(V) assuming that 
the smallest non-zero weight is 1. Let IZi C 2 V be a collection of the P-parameters of invocations 
of Cluster at depth < i < K of the recursion. (So, for example, TZq = {V}.) For a set U let 
S(U) be the small side of the cut produced by Cluster (G ,U or if no eligible cut was found. 
We can then bound the total weight of cut edges as 

J2 E w{s(u),u - s(u)) < E E^ vol (^))< E Ef vo1 ^) 

o<i<KUeiii o<i<KUeiz z o<i<KUeHi 

< 2 Z> 1^ voi{U) < - 2^ voi(y) < voi(y), 

0<i<KUe1li 0<i<K 

Where we use the convention w(®,S) = 0. If we set £ = i og4/3 3 voi(v / ) ' ^ or some < C < 1> then 
Corollary 3.2 establishes the theorem. □ 
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